Bootstrapping Monte Carlo Tree Search with an Imperfect Heuristic

We consider the problem of using a heuristic policy to improve the value approximation by the Upper Confidence Bound applied in Trees (UCT) algorithm in non-adversarial settings such as planning with large-state space Markov Decision Processes. Current improvements to UCT focus on either changing the action selection formula at the internal nodes or the rollout policy at the leaf nodes of the search tree. In this work, we propose to add an auxiliary arm to each of the internal nodes, and always use the heuristic policy to roll out simulations at the auxiliary arms. The method aims to get fast convergence to optimal values at states where the heuristic policy is optimal, while retaining similar approximation as the original UCT in other states. We show that bootstrapping with the proposed method in the new algorithm, UCT-Aux, performs better compared to the original UCT algorithm and its variants in two benchmark experiment settings. We also examine conditions under which UCT-Aux works well.Comment: 16 pages, accepted for presentation at ECML'1

Protein Peeling 2: a web server to convert protein structures into series of protein units

Protein Peeling 2 (PP2) is a web server for the automatic identification of protein units (PUs) given the 3D coordinates of a protein. PUs are an intermediate level of protein structure description between protein domains and secondary structures. It is a new tool to better understand and analyze the organization of protein structures. PP2 uses only the matrices of protein contact probabilities and cuts the protein structures optimally using Matthews' coefficient correlation. An index assesses the compactness quality of each PU. Results are given both textually and graphically using JMol and PyMol softwares. The server can be accessed from

Electron spin resonance - thermoluminescence studies on irradiated drugs and excipients

Issu de : 12th International Meeting on Radiation Processing (IMRP-12), AVIGNON, FRANCE, MAR 25-30, 2001International audienceThe methods (ESR, TL, GPC) developed to prove whether or not a foodstuff has been irradiated can be used to get the same proof in case of an irradiation treatment of drugs, excipients and cosmetic products

Helioseismology with PICARD

PICARD is a CNES micro-satellite launched in June 2010 (Thuillier at al. 2006). Its main goal is to measure the solar shape, total and spectral irradiance during the ascending phase of the activity cycle. The SODISM telescope onboard PICARD also allows us to conduct a program for helioseismology in intensity at 535.7 nm (Corbard et al. 2008). One-minute cadence low-resolution full images are available for a so-called medium-$l$ program, and high-resolution images of the limb recorded every 2 minutes are used to study mode amplification near the limb in the perspective of g-mode search. First analyses and results from these two programs are presented here.Comment: 6 pages, 6 figures, Eclipse on the Coral Sea: Cycle 24 Ascending, GONG 2012 / LWS/SDO-5 / SOHO 27, November 12 - 16, 2012, Palm Cove, Queensland. Accepted for publication in Journal of Physics Conference Series on March 1st 201

The onset of solar cycle 24: What global acoustic modes are telling us

We study the response of the low-degree, solar p-mode frequencies to the unusually extended minimum of solar surface activity since 2007. A total of 4768 days of observations collected by the space-based, Sun-as-a-star helioseismic GOLF instrument are analyzed. A multi-step iterative maximum-likelihood fitting method is applied to subseries of 365 days and 91.25 days to extract the p-mode parameters. Temporal variations of the l=0, 1, and 2 p-mode frequencies are then obtained from April 1996 to May 2009. While the p-mode frequency shifts are closely correlated with solar surface activity proxies during the past solar cycles, the frequency shifts of the l=0 and l=2 modes show an increase from the second half of 2007, when no significant surface activity is observable. On the other hand, the l=1 modes follow the general decreasing trend of the solar surface activity. The different behaviours between the l=0 and l=2 modes and the l=1 modes can be interpreted as different geometrical responses to the spatial distribution of the solar magnetic field beneath the surface of the Sun. The analysis of the low-degree, solar p-mode frequency shifts indicates that the solar activity cycle 24 started late 2007, despite the absence of activity on the solar surface.Comment: To be accepted by A&A (with minor revisions), 4 pages, 3 figures, 1 tabl

Hybridizing Constraint Programming and Monte-Carlo Tree Search: Application to the Job Shop problem

International audienceConstraint Programming (CP) solvers classically explore the solution space using tree search-based heuristics. Monte-Carlo Tree-Search (MCTS), a tree-search based method aimed at sequential decision making under uncertainty, simultaneously estimates the reward associated to the sub-trees, and gradually biases the exploration toward the most promising regions. This paper examines the tight combination of MCTS and CP on the job shop problem (JSP). The contribution is twofold. Firstly, a reward function compliant with the CP setting is proposed. Secondly, a biased MCTS node-selection rule based on this reward is proposed, that is suitable in a multiple-restarts context. Its integration within the Gecode constraint solver is shown to compete with JSP-specific CP approaches on difficult JSP instances

About the p-mode frequency shifts in HD 49933

We study the frequency dependence of the frequency shifts of the low-degree p modes measured in the F5V star HD 49933, by analyzing the second run of observations collected by the CoRoT satellite. The 137-day light curve is divided into two subseries corresponding to periods of low and high stellar activity. The activity-frequency relationship is obtained independently from the analysis of the mode frequencies extracted by both a local and a global peak-fitting analyses, and from a cross-correlation technique in the frequency range between 1450 microHz and 2500 microHz. The three methods return consistent results. We show that the frequency shifts measured in HD 49933 present a frequency dependence with a clear increase with frequency, reaching a maximal shift of about 2 microHz around 2100 microHz. Similar variations are obtained between the l=0 and l=1 modes. At higher frequencies, the frequency shifts show indications of a downturn followed by an upturn, consistent between the l=0 and 1 modes. We show that the frequency variation of the p-mode frequency shifts of the solar-like oscillating star HD 49933 has a comparable shape to the one observed in the Sun, which is understood to arise from changes in the outer layers due to its magnetic activity.Comment: 5 pages, 3 figures, 1 table, Accepted for publication in A\&